Busch Complexity Lectures: 


Turings Thesis 
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Turings thesis (1930): 
Any computation carried out 


by mechanical means 
can be performed by a Turing Machine 


Costas Busch - LSU 


Algorithm: 


An algorithm for a problem is a 
Turing Machine which solves the problem 


The algorithm describes the steps of 
the mechanical means 


This is easily translated to computation steps 
of a Turing machine 
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When we say: There exists an algorithm 


We mean: There exists a Turing Machine 
that executes the algorithm 
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Variations 
of the 
Turing Machine 
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The Standard Model 
Infinite Tape 


бб аа аЬ Ьсас|а| 


Read-Write Head (Left or Right) 


Control Unit 
от © 
UNO) 
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Deterministic 


Variations of the Standard Model 


Turing machines with: “ Stay-Option 
“ Semi-Infinite Tape 
: Multitape 
: Multidimensional 
“ Nondeterministic 


Different Turing Machine Classes 
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Same Power of two machine classes: 
both classes accept the 
same set of languages 


We will prove: 
each new class has the same power 
with Standard Turing Machine 


(accept Turing-Recognizable Languages) 
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Same Power of two classes means: 


for any machine M4 of first class 


there is a machine М» of second class 
such that: L(M,)=L(M>) 


and vice-versa 
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Simulation: A technique to prove same power. 
Simulate the machine of one class 
with a machine of the other class 


Second Class 
First Class Simulation Machine 
Original Machine 


simulates M, 
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Configurations in the Original Machine М] 
have corresponding configurations 
іп the Simulation Machine M» 


М. 
Original Machine: dg > dj > > а, 


| | | 


с к к 
Simulation Machine: dg > dj > = > d, 
М? 
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Accepting Configuration 


Original Machine: d y 
Simulation Machine: а” 


the Simulation Machine 

and the Original Machine 

accept the same strings 
LM) = КМ») 
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Turing Machines with Stay-Option 


The head can stay in the same position 
()\O\aialb alblbiclaicia фу 
Left, Right, Stay 


L,R,S: possible head moves 
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Example: Time 1 


0 баа аһы! сас а уд) 


qi 
Time 2 


0 ОрађарЬсаса()00 


42 


аг a—>b,S D 
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Theorem: Stay-Option machines 
have the same power with 
Standard Turing machines 


Proof: 1. Stay-Option Machines 
simulate Standard Turing machines 


2. Standard Turing machines 
simulate Stay-Option machines 
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1. Stay-Option Machines 
simulate Standard Turing machines 


Trivial: any standard Turing machine 
is also a Stay-Option machine 
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2. Standard Turing machines 
simulate Stay-Option machines 


We need to simulate the stay head option 
with two head moves, one left and one right 
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Stay-Option Machine 
a —b,S 


Simulation in Standard Machine 


For every possible tape symbol X 
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For other transitions nothing changes 


Stay-Option Machine 
а->Б,1, 


Simulation іп Standard Machine 
а->Б,1, 


Similar for Right moves 
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example of simulation 


Stay-Option Machine: 


a—b,S 
VaapaN  ОБаБаф 
41 42 


Simulation іп Standard Machine: 
OlalalblalO [OlblablalO  Wplalbla& 
1 2 3 
41 42 43 


END OF PROOF 
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A useful trick: Multiple Track Tape 


helps for more complicated simulations 


One Tape 


IN 
0|Olalpja(b|O| tracki 
DECIDE track 2 


One head 
One symbol (a,b) 


It is a standard Turing machine, but each tape alphabet symbol 


describes a pair of actual useful symbols 
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0 0аһаьфд 
0j0jbja|c|d|O 


qi 


001a ca bjo 
Оба еа 
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(b,a) > (еа), І, 


track 1 
track 2 


track 1 
track 2 


4) — — —€» 
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Semi-Infinite Tape 
The head extends infinitely only to the right 


аБһас00 — 


- Initial position is the leftmost cell 


e When the head moves left from the border, 
it returns back to leftmost position 
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Theorem: Semi-Infinite machines 
have the same power with 
Standard Turing machines 


Proof: 1 Standard Turing machines 
simulate Semi-Infinite machines 


2. Semi-Infinite Machines 
simulate Standard Turing machines 
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1. Standard Turing machines simulate 
Semi-Infinite machines: 


Standard Turing Machine 
Semi-Infinite machine modifications 


a. insert special symbol # 


at left of input string 


b. Add a self-loop 
То every state 
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2. Semi-Infinite tape machines simulate 
Standard Turing machines: 


Standard machine 


Squeeze infinity of both directions 
to one direction 
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Standard machine 


22. б аъ сјае О" 


reference point 


Semi-Infinite tape machine with two tracks 
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Standard machine 
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Standard machine 


HL Каў 
Semi-Infinite tape machine 
B wet #3 (a,x) — (g,x),R 6; 
-> L 
aft ont > (х,а) — (x, g), e 


For all tape symbols .X 
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Standard machine 


01411641100 m 
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Semi-Infinite tape machine 
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Standard machine 


olgblelalelolo m 
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Semi-Infinite tape machine 
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At the border: 


Semi-Infinite tape machine 


Right part 
Left part 
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Semi-Infinite tape machine 


END OF PROOF 
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Multi-tape Turing Machines 


Control unit 
(state machine) 


Input string 


Input string appears on Tape 1 
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Tape 1 Time 1 Tape 2 


41 41 
Таре 1 Тіте 2 Таре 2 
42 42 


b, f) (о, а), І, 
(ах /)->(& DERG 
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Theorem: Multi-tape machines 
have the same power with 
Standard Turing machines 


Proof: 1. Multi-tape machines 
simulate Standard Turing machines 


2. Standard Turing machines 
simulate Multi-tape machines 
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1. Multi-tape machines simulate 
Standard Turing Machines: 


Trivial: Use one tape 
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2. Standard Turing machines simulate 
Multi-tape machines: 


Standard machine: 


* Uses a multi-track tape to simulate 
the multiple tapes 


- A tape of the Multi-tape machine 
corresponds to a pair of tracks 
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Multi-tape Machine 


Tape 1 Tape 2 
барс у ole fel nl 


Standard machine with four track tape 


Tape 1 
head position 
Tape 2 
head position 


Reference point 

Tape 1 

head position 
Tape 2 

head position 


Repeat for each Multi-tape state transition: 
1. Return to reference point 
2. Find current symbol in Track 1 and update 
3. Return to reference point 
4. Find current symbol in Tape 2 and update 
END OF PROOF » 
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Same power doesnt imply same speed: 
L= (a^ b^ 


Standard Turing machine: O(n?) time 


Go back and forth O(n?) times 
to match the a's with the b's 


2-tape machine: O(n) time 
1. Copy b” to tape 2 (O(n) steps) 


2. Compare a” on tape 1 
and b” tape 2 (О(п) steps) 
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Multidimensional Turing Machines 


2-dimensional tape y 


TK Op EEE 
-4- аі | | |y x 


MOVES: L,R,U,D HEAD 
U:up D: down Position: +2, -1 
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Theorem: Multidimensional machines 
have the same power with 
Standard Turing machines 


Proof: 1. Multidimensional machines 
simulate Standard Turing machines 


2. Standard Turing machines 
simulate Multi-Dimensional machines 
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1. Multidimensional machines simulate 
Standard Turing machines 


Trivial: Use one dimension 
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2. Standard Turing machines simulate 
Multidimensional machines 


Standard machine: 
- Use a two track tape 


: Store symbols in track 1 
* Store coordinates in track 2 
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2-dimensional machine 
y 


21119410 
Феја | 


оъ? 
PTL PN 


ҮТ 
ТО -| UA] 
МАЙ к 
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Standard machine: 


Repeat for each transition followed 
in the 2-dimensional machine: 


1. Update current symbol 
2. Compute coordinates of next position 
3. Go to new position 


END OF PROOF 
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Nondeterministic Turing Machines 


TUN; Choice 1 
а 


a—c,R (аз) Choice 2 


Allows Non Deterministic Choices 
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Time O 


Оа5с0 


Тіте 1 


Choice 1 


аа 
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Choice 2 


Oiclble do 


q3 
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Input string W is accepted if 
there is a computation: 
к 


qow > хдуу 
/ N 


Initial configuration Final Configuration 


Any accept state 


There is a computation: 


- 
2 
ай “ 
< \ 
\ 
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Theorem: Nondeterministic machines 
have the same power with 
Standard Turing machines 


Proof: 1 Nondeterministic machines 
simulate Standard Turing machines 


2. Standard Turing machines 
simulate Nondeterministic machines 
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1. Nondeterministic Machines simulate 
Standard (deterministic) Turing Machines 


Trivial: every deterministic machine 
is also nondeterministic 
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2. Standard (deterministic) Turing machines 
simulate Nondeterministic machines: 


Deterministic machine: 


- Uses a 2-dimensional tape 
(equivalent to standard Turing machine with one tape) 


- Stores all possible computations 
of the non-deterministic machine 
on the 2-dimensional tape 
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All possible computation paths 
Initial state 


Step 1 


Ф Step г 


4 ai 


reject — accept infinite Step isi 
path 
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The Deterministic Turing machine 
simulates all possible computation paths: 


“simultaneously 
-step-by-step 


“with breadth-first search 


depth-first may result getting stuck at exploring 
an infinite path before discovering the accepting path 
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NonDeterministic machine 


> b.L Time O 
9а [5 


91 
a—c,R (аз. 


Deterministic machine 


current 
configuration 
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NonDeterministic machine 
Time 1 


a—b,L O|b|b|c|Ó| choice 1 
42 
а. 01110] Choice 2 
a—c,R (аз. d 


Computation 1 


Computation 2 
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Deterministic Turing machine 


Repeat 
For each configuration in current step 
of non-deterministic machine, 
if there are two or more choices: 
1. Replicate configuration 
2. Change the state in the replicas 


Until either the input string is accepted 
or rejected in all configurations 
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If the non-deterministic machine accepts 
the input string: 


The deterministic machine accepts and halts too 


The simulation takes in the worst case 
exponential time compared to the 
shortest length of an accepting path 
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If the non-deterministic machine does not 
accept the input string: 


1. The simulation halts if all paths 
reach a halting state 
OR 
2. The simulation never terminates 
if there is a never-ending path (infinite loop) 


In either case the deterministic machine 
rejects TOO (1. by halting or 2. by simulating the infinite loop) 


END OF PROOF 
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